Handling gestures for changing focus

ABSTRACT

Embodiments are described for handling focus when a gesture is input in a multi-screen device. In embodiments, if the gesture is incomplete a focus is maintained on a screen, display area, or displayed image that has the focus. If the gesture is determined to be complete, then the focus is changed to a different screen, display area, or displayed image.

CROSS REFERENCE TO RELATED APPLICATION

The present application claims the benefits of and priority, under 35U.S.C. §119(e), to U.S. Provisional Application Ser. No. 61/389,000,filed Oct. 1, 2010, entitled “DUAL DISPLAY WINDOWING SYSTEM;” Ser. No.61/389,117, filed Oct. 1, 2010, entitled “MULTI-OPERATING SYSTEMPORTABLE DOCKETING DEVICE;” Ser. No. 61/389,087, filed Oct. 1, 2010,entitled “TABLET COMPUTING USER INTERFACE.” Each of the aforementioneddocuments is incorporated herein by this reference in their entirety forall that they teach and for all purposes.

BACKGROUND

A substantial number of handheld computing devices, such as cellularphones, tablets, and E-Readers, make use of a touch screen display notonly to deliver display information to the user but also to receiveinputs from user interface commands. While touch screen displays mayincrease the configurability of the handheld device and provide a widevariety of user interface options, this flexibility typically comes at aprice. The dual use of the touch screen to provide content and receiveuser commands, while flexible for the user, may obfuscate the displayand cause visual clutter, thereby leading to user frustration and lossof productivity.

The small form factor of handheld computing devices requires a carefulbalancing between the displayed graphics and the area provided forreceiving inputs. On the one hand, the small display constrains thedisplay space, which may increase the difficulty of interpreting actionsor results. On the other, a virtual keypad or other user interfacescheme is superimposed on or positioned adjacent to an executingapplication, requiring the application to be squeezed into an evensmaller portion of the display.

This balancing act is particularly difficult for single display touchscreen devices. Single display touch screen devices are crippled bytheir limited screen space. When users are entering information into thedevice, through the single display, the ability to interpret informationin the display can be severely hampered, particularly when a complexinteraction between display and interface is required.

SUMMARY

There is a need for a dual multi-display handheld computing device thatprovides for enhanced power and/or versatility compared to conventionalsingle display handheld computing devices. These and other needs areaddressed by the various aspects, embodiments, and/or configurations ofthe present disclosure. Also, while the disclosure is presented in termsof exemplary embodiments, it should be appreciated that individualaspects of the disclosure can be separately claimed.

In one embodiment, a method includes receiving, by at least one of agesture capture region and a touch sensitive display, a gestureindicating a request to change focus. A determination is made by atleast one processor whether the gesture is completed. In response to theat least one processor determining that the gesture is not completed, afocus is maintained on a first screen that has the focus.

Another embodiment is directed to a non-transitory computer readablemedium storing computer executable instructions that when executed by atleast one processor perform a method that includes receiving, by agesture capture region, a drag gesture indicating a request to changefocus. A determination is made whether the drag gesture is completed. Ifa determination is made that the drag gesture is not completed a focusis maintained on an image displayed on a first screen. If adetermination is made that the gesture is completed, the focus ischanged from the first image to a second image displayed on a secondscreen.

Yet another embodiment is directed to a dual screen communicationdevice. The communication device includes a gesture capture region toreceive a gesture, a first touch sensitive display; a second touchsensitive display; and a computer readable medium that stores computerexecutable instructions that when executed by at least one processorperform a method that includes receiving, by at least one of the gesturecapture region, the first touch sensitive display, or the second touchsensitive display, a gesture indicating a request to change focus. Adetermination is then made whether the gesture is completed. If adetermination is made that the gesture is not completed, a focus ismaintained on a first touch sensitive display.

The present disclosure can provide a number of advantages depending onthe particular aspect, embodiment, and/or configuration. In a devicethat includes more than one screen, a decision must be made by thedevice as to what screen, display area, or displayed image has thefocus. This decision must be made so that any input received by a usercan be associated with a screen, display area, or displayed image. Inembodiments, only when gestures are completed is the focus changed toanother screen, display area, or displayed image. This solves theproblem of the device needing to decide whether to change focus when itreceives a gesture that is not complete. These and other advantages willbe apparent from the disclosure.

The phrases “at least one”, “one or more”, and “and/or” are open-endedexpressions that are both conjunctive and disjunctive in operation. Forexample, each of the expressions “at least one of A, B and C”, “at leastone of A, B, or C”, “one or more of A, B, and C”, “one or more of A, B,or C” and “A, B, and/or C” means A alone, B alone, C alone, A and Btogether, A and C together, B and C together, or A, B and C together.

The term “a” or “an” entity refers to one or more of that entity. Assuch, the terms “a” (or “an”), “one or more” and “at least one” can beused interchangeably herein. It is also to be noted that the terms“comprising”, “including”, and “having” can be used interchangeably.

The term “automatic” and variations thereof, as used herein, refers toany process or operation done without material human input when theprocess or operation is performed. However, a process or operation canbe automatic, even though performance of the process or operation usesmaterial or immaterial human input, if the input is received beforeperformance of the process or operation. Human input is deemed to bematerial if such input influences how the process or operation will beperformed. Human input that consents to the performance of the processor operation is not deemed to be “material”.

The term “computer-readable medium” as used herein refers to anytangible storage and/or transmission medium that participate inproviding instructions to a processor for execution. Such a medium maytake many forms, including but not limited to, non-volatile media,volatile media, and transmission media. Non-volatile media includes, forexample, NVRAM, or magnetic or optical disks. Volatile media includesdynamic memory, such as main memory. Common forms of computer-readablemedia include, for example, a floppy disk, a flexible disk, hard disk,magnetic tape, or any other magnetic medium, magneto-optical medium, aCD-ROM, any other optical medium, punch cards, paper tape, any otherphysical medium with patterns of holes, a RAM, a PROM, and EPROM, aFLASH-EPROM, a solid state medium like a memory card, any other memorychip or cartridge, a carrier wave as described hereinafter, or any othermedium from which a computer can read. A digital file attachment toe-mail or other self-contained information archive or set of archives isconsidered a distribution medium equivalent to a tangible storagemedium. When the computer-readable media is configured as a database, itis to be understood that the database may be any type of database, suchas relational, hierarchical, object-oriented, and/or the like.Accordingly, the disclosure is considered to include a tangible storagemedium or distribution medium and prior art-recognized equivalents andsuccessor media, in which the software implementations of the presentdisclosure are stored.

The term “desktop” refers to a metaphor used to portray systems. Adesktop is generally considered a “surface” that typically includespictures, called icons, widgets, folders, etc. that can activate showapplications, windows, cabinets, files, folders, documents, and othergraphical items. The icons are generally selectable to initiate a taskthrough user interface interaction to allow a user to executeapplications or conduct other operations.

The term “display” refers to a portion of a screen used to display theoutput of a computer to a user.

The term “displayed image” refers to an image produced on the display. Atypical displayed image is a window or desktop. The displayed image mayoccupy all or a portion of the display.

The term “display orientation” refers to the way in which a rectangulardisplay is oriented by a user for viewing. The two most common types ofdisplay orientation are portrait and landscape. In landscape mode, thedisplay is oriented such that the width of the display is greater thanthe height of the display (such as a 4:3 ratio, which is 4 units wideand 3 units tall, or a 16:9 ratio, which is 16 units wide and 9 unitstall). Stated differently, the longer dimension of the display isoriented substantially horizontal in landscape mode while the shorterdimension of the display is oriented substantially vertical. In theportrait mode, by contrast, the display is oriented such that the widthof the display is less than the height of the display. Stateddifferently, the shorter dimension of the display is orientedsubstantially horizontal in the portrait mode while the longer dimensionof the display is oriented substantially vertical. The multi-screendisplay can have one composite display that encompasses all the screens.The composite display can have different display characteristics basedon the various orientations of the device.

The term “gesture” refers to a user action that expresses an intendedidea, action, meaning, result, and/or outcome. The user action caninclude manipulating a device (e.g., opening or closing a device,changing a device orientation, moving a trackball or wheel, etc.),movement of a body part in relation to the device, movement of animplement or tool in relation to the device, audio inputs, etc. Agesture may be made on a device (such as on the screen) or with thedevice to interact with the device.

The term “module” as used herein refers to any known or later developedhardware, software, firmware, artificial intelligence, fuzzy logic, orcombination of hardware and software that is capable of performing thefunctionality associated with that element.

The term “gesture capture” refers to a sense or otherwise a detection ofan instance and/or type of user gesture. The gesture capture can occurin one or more areas of the screen, A gesture region can be on thedisplay, where it may be referred to as a touch sensitive display or offthe display where it may be referred to as a gesture capture area.

A “multi-screen application” refers to an application that is capable ofproducing one or more windows that may simultaneously occupy multiplescreens. A multi-screen application commonly can operate insingle-screen mode in which one or more windows of the application aredisplayed only on one screen or in multi-screen mode in which one ormore windows are displayed simultaneously on multiple screens.

A “single-screen application” refers to an application that is capableof producing one or more windows that may occupy only a single screen ata time.

The term “screen,” “touch screen,” or “touchscreen” refers to a physicalstructure that enables the user to interact with the computer bytouching areas on the screen and provides information to a user througha display. The touch screen may sense user contact in a number ofdifferent ways, such as by a change in an electrical parameter (e.g.,resistance or capacitance), acoustic wave variations, infrared radiationproximity detection, light variation detection, and the like. In aresistive touch screen, for example, normally separated conductive andresistive metallic layers in the screen pass an electrical current. Whena user touches the screen, the two layers make contact in the contactedlocation, whereby a change in electrical field is noted and thecoordinates of the contacted location calculated. In a capacitive touchscreen, a capacitive layer stores electrical charge, which is dischargedto the user upon contact with the touch screen, causing a decrease inthe charge of the capacitive layer. The decrease is measured, and thecontacted location coordinates determined. In a surface acoustic wavetouch screen, an acoustic wave is transmitted through the screen, andthe acoustic wave is disturbed by user contact. A receiving transducerdetects the user contact instance and determines the contacted locationcoordinates.

The term “window” refers to a, typically rectangular, displayed image onat least part of a display that contains or provides content differentfrom the rest of the screen. The window may obscure the desktop.

The terms “determine”, “calculate” and “compute,” and variationsthereof, as used herein, are used interchangeably and include any typeof methodology, process, mathematical operation or technique.

The term “focus” refers to being active and/or selected to receiveinput. A screen, a display, or a component (e.g., displayed image) of adisplayed graphical user interface may have the “focus.”

It shall be understood that the term “means” as used herein shall begiven its broadest possible interpretation in accordance with 35 U.S.C.,Section 112, Paragraph 6. Accordingly, a claim incorporating the term“means” shall cover all structures, materials, or acts set forth herein,and all of the equivalents thereof. Further, the structures, materialsor acts and the equivalents thereof shall include all those described inthe summary of the invention, brief description of the drawings,detailed description, abstract, and claims themselves.

The preceding is a simplified summary of the disclosure to provide anunderstanding of some aspects of the disclosure. This summary is neitheran extensive nor exhaustive overview of the disclosure and its variousaspects, embodiments, and/or configurations. It is intended neither toidentify key or critical elements of the disclosure nor to delineate thescope of the disclosure but to present selected concepts of thedisclosure in a simplified form as an introduction to the more detaileddescription presented below. As will be appreciated, other aspects,embodiments, and/or configurations of the disclosure are possibleutilizing, alone or in combination, one or more of the features setforth above or described in detail below.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A includes a first view of an embodiment of a multi-screen userdevice;

FIG. 1B includes a second view of an embodiment of a multi-screen userdevice;

FIG. 1C includes a third view of an embodiment of a multi-screen userdevice;

FIG. 1D includes a fourth view of an embodiment of a multi-screen userdevice;

FIG. 1E includes a fifth view of an embodiment of a multi-screen userdevice;

FIG. 1F includes a sixth view of an embodiment of a multi-screen userdevice;

FIG. 1G includes a seventh view of an embodiment of a multi-screen userdevice;

FIG. 1H includes a eighth view of an embodiment of a multi-screen userdevice;

FIG. 1I includes a ninth view of an embodiment of a multi-screen userdevice;

FIG. 1J includes a tenth view of an embodiment of a multi-screen userdevice;

FIG. 2 is a block diagram of an embodiment of the hardware of thedevice;

FIG. 3A is a block diagram of an embodiment of the state model for thedevice based on the device's orientation and/or configuration;

FIG. 3B is a table of an embodiment of the state model for the devicebased on the device's orientation and/or configuration;

FIG. 4A is a first representation of an embodiment of user gesturereceived at a device;

FIG. 4B is a second representation of an embodiment of user gesturereceived at a device;

FIG. 4C is a third representation of an embodiment of user gesturereceived at a device;

FIG. 4D is a fourth representation of an embodiment of user gesturereceived at a device;

FIG. 4E is a fifth representation of an embodiment of user gesturereceived at a device;

FIG. 4F is a sixth representation of an embodiment of user gesturereceived at a device;

FIG. 4G is a seventh representation of an embodiment of user gesturereceived at a device;

FIG. 4H is a eighth representation of an embodiment of user gesturereceived at a device;

FIG. 5A is a block diagram of an embodiment of the device softwareand/or firmware;

FIG. 5B is a second block diagram of an embodiment of the devicesoftware and/or firmware;

FIG. 6A is a first representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6B is a second representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6C is a third representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6D is a fourth representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6E is a fifth representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6F is a sixth representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6G is a seventh representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6H is a eighth representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6I is a ninth representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIG. 6J is a tenth representation of an embodiment of a deviceconfiguration generated in response to the device state;

FIGS. 7A-7C are a representation of an embodiment showing a first screenthat has a focus and the response when an incomplete gesture is made;

FIGS. 8A-8C are a representation of a second embodiment showing a firstscreen and an image displayed on the first screen that have a focus andthe response when an incomplete gesture is made;

FIGS. 9A-9C are a representation of an embodiment showing a first screenand an image displayed on the first screen that have a focus and theresponse when a complete gesture is made; and

FIG. 10 illustrates a flow chart of an embodiment for handling agesture.

In the appended figures, similar components and/or features may have thesame reference label. Further, various components of the same type maybe distinguished by following the reference label by a letter thatdistinguishes among the similar components. If only the first referencelabel is used in the specification, the description is applicable to anyone of the similar components having the same first reference labelirrespective of the second reference label.

DETAILED DESCRIPTION

Presented herein are embodiments of a device. The device can be acommunications device, such as a cellular telephone, or other smartdevice. The device can include two screens that are oriented to provideseveral unique display configurations. Further, the device can receiveuser input in unique ways. The overall design and functionality of thedevice provides for an enhanced user experience making the device moreuseful and more efficient.

Mechanical Features:

FIGS. 1A-1J illustrate a device 100 in accordance with embodiments ofthe present disclosure. As described in greater detail below, device 100can be positioned in a number of different ways each of which providesdifferent functionality to a user. The device 100 is a multi-screendevice that includes a primary screen 104 and a secondary screen 108,both of which are touch sensitive. In embodiments, the entire frontsurface of screens 104 and 108 may be touch sensitive and capable ofreceiving input by a user touching the front surface of the screens 104and 108. Primary screen 104 includes touch sensitive display 110, which,in addition to being touch sensitive, also displays information to auser. Secondary screen 108 includes touch sensitive display 114, whichalso displays information to a user. In other embodiments, screens 104and 108 may include more than one display area.

Primary screen 104 also includes a configurable area 112 that has beenconfigured for specific inputs when the user touches portions of theconfigurable area 112. Secondary screen 108 also includes a configurablearea 116 that has been configured for specific inputs. Areas 112 a and116 a have been configured to receive a “back” input indicating that auser would like to view information previously displayed. Areas 112 band 116 b have been configured to receive a “menu” input indicating thatthe user would like to view options from a menu. Areas 112 c and 116 chave been configured to receive a “home” input indicating that the userwould like to view information associated with a “home” view. In otherembodiments, areas 112 a-c and 116 a-c may be configured, in addition tothe configurations described above, for other types of specific inputsincluding controlling features of device 100, some non-limiting examplesincluding adjusting overall system power, adjusting the volume,adjusting the brightness, adjusting the vibration, selecting ofdisplayed items (on either of screen 104 or 108), operating a camera,operating a microphone, and initiating/terminating of telephone calls.Also, in some embodiments, areas 112 a-C and 116 a-C may be configuredfor specific inputs depending upon the application running on device 100and/or information displayed on touch sensitive displays 110 and/or 114.

In addition to touch sensing, primary screen 104 and secondary screen108 may also include areas that receive input from a user withoutrequiring the user to touch the display area of the screen. For example,primary screen 104 includes gesture capture area 120, and secondaryscreen 108 includes gesture capture area 124. These areas are able toreceive input by recognizing gestures made by a user without the needfor the user to actually touch the surface of the display area. Incomparison to touch sensitive displays 110 and 114, the gesture captureareas 120 and 124 are commonly not capable of rendering a displayedimage.

The two screens 104 and 108 are connected together with a hinge 128,shown clearly in FIG. 1C (illustrating a back view of device 100). Hinge128, in the embodiment shown in FIGS. 1A-1J, is a center hinge thatconnects screens 104 and 108 so that when the hinge is closed, screens104 and 108 are juxtaposed (i.e., side-by-side) as shown in FIG. 1B(illustrating a front view of device 100). Hinge 128 can be opened toposition the two screens 104 and 108 in different relative positions toeach other. As described in greater detail below, the device 100 mayhave different functionalities depending on the relative positions ofscreens 104 and 108.

FIG. 1D illustrates the right side of device 100. As shown in FIG. 1D,secondary screen 108 also includes a card slot 132 and a port 136 on itsside. Card slot 132 in embodiments, accommodates different types ofcards including a subscriber identity module (SIM). Port 136 inembodiments is an input/output port (I/O port) that allows device 100 tobe connected to other peripheral devices, such as a display, keyboard,or printing device. As can be appreciated, these are merely someexamples and in other embodiments device 100 may include other slots andports such as slots and ports for accommodating additional memorydevices and/or for connecting other peripheral devices. Also shown inFIG. 1D is an audio jack 140 that accommodates a tip, ring, sleeve (TRS)connector for example to allow a user to utilize headphones or aheadset.

Device 100 also includes a number of buttons 158. For example, FIG. 1Eillustrates the left side of device 100. As shown in FIG. 1E, the sideof primary screen 104 includes three buttons 144, 148, and 152, whichcan be configured for specific inputs. For example, buttons 144, 148,and 152 may be configured to, in combination or alone, control a numberof aspects of device 100. Some non-limiting examples include overallsystem power, volume, brightness, vibration, selection of displayeditems (on either of screen 104 or 108), a camera, a microphone, andinitiation/termination of telephone calls. In some embodiments, insteadof separate buttons two buttons may be combined into a rocker button.This arrangement is useful in situations where the buttons areconfigured to control features such as volume or brightness. In additionto buttons 144, 148, and 152, device 100 also includes a button 156,shown in FIG. 1F, which illustrates the top of device 100. In oneembodiment, button 156 is configured as an on/off button used to controloverall system power to device 100. In other embodiments, button 156 isconfigured to, in addition to or in lieu of controlling system power,control other aspects of device 100. In some embodiments, one or more ofthe buttons 144, 148, 152, and 156 are capable of supporting differentuser commands. By way of example, a normal press has a duration commonlyof less than about 1 second and resembles a quick tap. A medium presshas a duration commonly of 1 second or more but less than about 12seconds. A long press has a duration commonly of about 12 seconds ormore. The function of the buttons is normally specific to theapplication that is currently in focus on the respective display 110 and114. In a telephone application for instance and depending on theparticular button, a normal, medium, or long press can mean end call,increase in call volume, decrease in call volume, and toggle microphonemute. In a camera or video application for instance and depending on theparticular button, a normal, medium, or long press can mean increasezoom, decrease zoom, and take photograph or record video.

There are also a number of hardware components within device 100. Asillustrated in FIG. 1C, device 100 includes a speaker 160 and amicrophone 164. Device 100 also includes a camera 168 (FIG. 1B).Additionally, device 100 includes two position sensors 172A and 172B,which are used to determine the relative positions of screens 104 and108. In one embodiment, position sensors 172A and 172B are Hall effectsensors. However, in other embodiments other sensors can be used inaddition to or in lieu of the Hall effect sensors. An accelerometer 176may also be included as part of device 100 to determine the orientationof the device 100 and/or the orientation of screens 104 and 108.Additional internal hardware components that may be included in device100 are described below with respect to FIG. 2.

The overall design of device 100 allows it to provide additionalfunctionality not available in other communication devices. Some of thefunctionality is based on the various positions and orientations thatdevice 100 can have. As shown in FIGS. 1B-1G, device 100 can be operatedin an “open” position where screens 104 and 108 are juxtaposed. Thisposition allows a large display area for displaying information to auser. When position sensors 172A and 172B determine that device 100 isin the open position, they can generate a signal that can be used totrigger different events such as displaying information on both screens104 and 108. Additional events may be triggered if accelerometer 176determines that device 100 is in a portrait position (FIG. 1B) asopposed to a landscape position (not shown).

In addition to the open position, device 100 may also have a “closed”position illustrated in FIG. 1H. Again, position sensors 172A and 172Bcan generate a signal indicating that device 100 is in the “closed”position. This can trigger an event that results in a change ofdisplayed information on screen 104 and/or 108. For example, device 100may be programmed to stop displaying information on one of the screens,e.g., screen 108, since a user can only view one screen at a time whendevice 100 is in the “closed” position. In other embodiments, the signalgenerated by position sensors 172A and 172B, indicating that the device100 is in the “closed” position, can trigger device 100 to answer anincoming telephone call. The “closed” position can also be a preferredposition for utilizing the device 100 as a mobile phone.

Device 100 can also be used in an “easel” position which is illustratedin FIG. 1I. In the “easel” position, screens 104 and 108 are angled withrespect to each other and facing outward with the edges of screens 104and 108 substantially horizontal. In this position, device 100 can beconfigured to display information on both screens 104 and 108 to allowtwo users to simultaneously interact with device 100. When device 100 isin the “easel” position, sensors 172A and 172B generate a signalindicating that the screens 104 and 108 are positioned at an angle toeach other, and the accelerometer 176 can generate a signal indicatingthat device 100 has been placed so that the edge of screens 104 and 108are substantially horizontal. The signals can then be used incombination to generate events that trigger changes in the display ofinformation on screens 104 and 108.

FIG. 1J illustrates device 100 in a “modified easel” position. In the“modified easel” position, one of screens 104 or 108 is used as a standand is faced down on the surface of an object such as a table. Thisposition provides a convenient way for information to be displayed to auser in landscape orientation. Similar to the easel position, whendevice 100 is in the “modified easel” position, position sensors 172Aand 172B generate a signal indicating that the screens 104 and 108 arepositioned at an angle to each other. The accelerometer 176 wouldgenerate a signal indicating that device 100 has been positioned so thatone of screens 104 and 108 is faced downwardly and is substantiallyhorizontal. The signals can then be used to generate events that triggerchanges in the display of information of screens 104 and 108. Forexample, information may not be displayed on the screen that is facedown since a user cannot see the screen.

Transitional states are also possible. When the position sensors 172Aand B and/or accelerometer indicate that the screens are being closed orfolded (from open), a closing transitional state is recognized.Conversely when the position sensors 172A and B indicate that thescreens are being opened or folded (from closed), an openingtransitional state is recognized. The closing and opening transitionalstates are typically time-based, or have a maximum time duration from asensed starting point. Normally, no user input is possible when one ofthe closing and opening states is in effect. In this manner, incidentaluser contact with a screen during the closing or opening function is notmisinterpreted as user input. In embodiments, another transitional stateis possible when the device 100 is closed. This additional transitionalstate allows the display to switch from one screen 104 to the secondscreen 108 when the device 100 is closed based on some user input, e.g.,a double tap on the screen 110,114.

As can be appreciated, the description of device 100 is made forillustrative purposes only, and the embodiments are not limited to thespecific mechanical features shown in FIGS. 1A-1J and described above.In other embodiments, device 100 may include additional features,including one or more additional buttons, slots, display areas, hinges,and/or locking mechanisms. Additionally, in embodiments, the featuresdescribed above may be located in different parts of device 100 andstill provide similar functionality. Therefore, FIGS. 1A-1J and thedescription provided above are nonlimiting.

Hardware Features:

FIG. 2 illustrates components of a device 100 in accordance withembodiments of the present disclosure. In general, the device 100includes a primary screen 104 and a secondary screen 108. While theprimary screen 104 and its components are normally enabled in both theopened and closed positions or states, the secondary screen 108 and itscomponents are normally enabled in the opened state but disabled in theclosed state. However, even when in the closed state a user orapplication triggered interrupt (such as in response to a phoneapplication or camera application operation) can flip the active screen,or disable the primary screen 104 and enable the secondary screen 108,by a suitable command. Each screen 104, 108 can be touch sensitive andcan include different operative areas. For example, a first operativearea may comprise a touch sensitive display 110. In general, the touchsensitive display 110 may comprise a full color, touch sensitivedisplay. A second area within each touch sensitive screen 104 and 108may comprise a gesture capture region 120, 124. The gesture captureregion 120, 124 may comprise an area or region that is outside of thetouch sensitive display 110 area, and that is capable of receivinginput, for example in the form of gestures provided by a user. However,the gesture capture region 120, 124 does not include pixels that canperform a display function or capability.

A third region of the touch sensitive screens 104 and 108 may comprise aconfigurable area 112, 116. The configurable area 112, 116 is capable ofreceiving input and has display or limited display capabilities. Inembodiments, the configurable area 112, 116 may present different inputoptions to the user. For example, the configurable area 112, 116 maydisplay buttons or other relatable items. Moreover, the identity ofdisplayed buttons, or whether any buttons are displayed at all withinthe configurable area 112, 116 of a touch sensitive screen 104 or 108,may be determined from the context in which the device 100 is usedand/or operated. In an exemplary embodiment, the touch sensitive screens104 and 108 comprise liquid crystal display devices extending across atleast those regions of the touch sensitive screens 104 and 108 that arecapable of providing visual output to a user, and a capacitive inputmatrix over those regions of the touch sensitive screens 104 and 108that are capable of receiving input from the user.

One or more display controllers 216 a, 216 b may be provided forcontrolling the operation of the touch sensitive screens 104 and 108,including input (touch sensing) and output (display) functions. In theexemplary embodiment illustrated in FIG. 2, a separate touch screencontroller 216 a or 216 b is provided for each touch screens 104 and108. In accordance with alternate embodiments, a common or shared touchscreen controller 216 may be used to control each of the included touchsensitive screens 104 and 108. In accordance with still otherembodiments, the functions of a touch screen controller 216 may beincorporated into other components, such as a processor 204.

The processor 204 may comprise a general purpose programmable processoror controller for executing application programming or instructions. Inaccordance with at least some embodiments, the processor 204 may includemultiple processor cores, and/or implement multiple virtual processors.In accordance with still other embodiments, the processor 204 mayinclude multiple physical processors. As a particular example, theprocessor 110 may comprise a specially configured application specificintegrated circuit (ASIC) or other integrated circuit, a digital signalprocessor, a controller, a hardwired electronic or logic circuit, aprogrammable logic device or gate array, a special purpose computer, orthe like. The processor 110 generally functions to run programming codeor instructions implementing various functions of the device 100.

A communication device 100 may also include memory 208 for use inconnection with the execution of application programming or instructionsby the processor 204, and for the temporary or long term storage ofprogram instructions and/or data. As examples, the memory 208 maycomprise RAM, DRAM, SDRAM, or other solid state memory. Alternatively orin addition, data storage 212 may be provided. Like the memory 208, thedata storage 212 may comprise a solid state memory device or devices.Alternatively or in addition, the data storage 212 may comprise a harddisk drive or other random access memory.

In support of communications functions or capabilities, the device 100can include a cellular telephony module 228. As examples, the cellulartelephony module 228 can comprise a GSM, CDMA, FDMA and/or analogcellular telephony transceiver capable of supporting voice, multimediaand/or data transfers over a cellular network. Alternatively or inaddition, the device 100 can include an additional or other wirelesscommunications module 232. As examples, the other wirelesscommunications module 236 can comprise a Wi-Fi, Bluetooth, WiMax,infrared, or other wireless communications link. The cellular telephonymodule 228 and the other wireless communications module 236 can each beassociated with a shared or a dedicated antenna 224.

A port interface 244 may be included. The port interface 244 may includeproprietary or universal ports to support the interconnection of thedevice 100 to other devices or components, such as a dock, which may ormay not include additional or different capabilities from those integralto the device 100. In addition to supporting an exchange ofcommunication signals between the device 100 and another device orcomponent, the docking port 244 can support the supply of power to orfrom the device 100. The port interface 244 also comprises anintelligent element that comprises a docking module for controllingcommunications or other interactions between the device 100 and aconnected device or component.

An input/output module 248 and associated ports may be included tosupport communications over wired networks or links, for example withother communication devices, server devices, and/or peripheral devices.Examples of an input/output module 248 include an Ethernet port, a USBport, IEEE 1394, or other interface.

An audio input/output interface/device(s) 240 can be included to provideanalog audio to an interconnected speaker or other device, and toreceive analog audio input from a connected microphone or other device.As an example, the audio input/output interface/device(s) 240 maycomprise an associated amplifier and analog to digital converter.Alternatively or in addition, the device 100 can include an integratedaudio input/output device 256 and/or an audio jack for interconnectingan external speaker or microphone. For example, an integrated speakerand an integrated microphone can be provided, to support near talk orspeaker phone operations.

Hardware buttons 260 can be included for example for use in connectionwith certain control operations. Examples include a master power switch,volume control, etc., as described in conjunction with FIGS. 1A through1J. One or more image capture interfaces/devices 240, such as a camera,can be included for capturing still and/or video images. Alternativelyor in addition, an image capture interface/device 240 can include ascanner or code reader. An image capture interface/device 240 caninclude or be associated with additional elements, such as a flash orother light source.

The device 100 can also include a global positioning system (GPS)receiver 236. In accordance with embodiments of the present invention,the GPS receiver 236 may further comprise a GPS module that is capableof providing absolute location information to other components of thedevice 100. An accelerometer(s) 176 may also be included. For example,in connection with the display of information to a user and/or otherfunctions, a signal from the accelerometer 176 can be used to determinean orientation and/or format in which to display that information to theuser.

Embodiments of the present invention can also include one or moreposition sensor(s) 172. The position sensor 172 can provide a signalindicating the position of the touch sensitive screens 104 and 108relative to one another. This information can be provided as an input,for example to a user interface application, to determine an operatingmode, characteristics of the touch sensitive displays 110, 114, and/orother device 100 operations. As examples, a screen position sensor 172can comprise a series of Hall effect sensors, a multiple positionswitch, an optical switch, a Wheatstone bridge, a potentiometer, orother arrangement capable of providing a signal indicating of multiplerelative positions the touch screens are in.

Communications between various components of the device 100 can becarried by one or more buses 222. In addition, power can be supplied tothe components of the device 100 from a power source and/or powercontrol module 260. The power control module 260 can, for example,include a battery, an AC to DC converter, power control logic, and/orports for interconnecting the device 100 to an external source of power.

Device State:

FIGS. 3A and 3B represent illustrative states of device 100. While anumber of illustrative states are shown, and transitions from a firststate to a second state, it is to be appreciated that the illustrativestate diagram may not encompass all possible states and/or all possibletransitions from a first state to a second state. As illustrated in FIG.3, the various arrows between the states (illustrated by the staterepresented in the circle) represent a physical change that occurs tothe device 100, that is detected by one or more of hardware andsoftware, the detection triggering one or more of a hardware and/orsoftware interrupt that is used to control and/or manage one or morefunctions of device 100.

As illustrated in FIG. 3A, there are twelve exemplary “physical” states:closed 304, transition 308 (or opening transitional state), easel 312,modified easel 316, open 320, inbound/outbound call or communication324, image/video capture 328, transition 332 (or closing transitionalstate), landscape 340, docked 336, docked 344 and landscape 348. Next toeach illustrative state is a representation of the physical state of thedevice 100 with the exception of states 324 and 328, where the state isgenerally symbolized by the international icon for a telephone and theicon for a camera, respectfully.

In state 304, the device is in a closed state with the device 100generally oriented in the portrait direction with the primary screen 104and the secondary screen 108 back-to-back in different planes (see FIG.1H). From the closed state, the device 100 can enter, for example,docked state 336, where the device 100 is coupled with a dockingstation, docking cable, or in general docked or associated with one ormore other devices or peripherals, or the landscape state 340, where thedevice 100 is generally oriented with the primary screen 104 facing theuser, and the primary screen 104 and the secondary screen 108 beingback-to-back.

In the closed state, the device can also move to a transitional statewhere the device remains closed by the display is moved from one screen104 to another screen 108 based on a user input, e.g., a double tap onthe screen 110, 114. Still another embodiment includes a bilateralstate. In the bilateral state, the device remains closed, but a singleapplication displays at least one window on both the first display 110and the second display 114. The windows shown on the first and seconddisplay 110, 114 may be the same or different based on the applicationand the state of that application. For example, while acquiring an imagewith a camera, the device may display the view finder on the firstdisplay 110 and displays a preview for the photo subjects (full screenand mirrored left-to-right) on the second display 114.

In state 308, a transition state from the closed state 304 to thesemi-open state or easel state 312, the device 100 is shown opening withthe primary screen 104 and the secondary screen 108 being rotated arounda point of axis coincidence with the hinge. Upon entering the easelstate 312, the primary screen 104 and the secondary screen 108 areseparated from one another such that, for example, the device 100 cansit in an easel-like configuration on a surface.

In state 316, known as the modified easel position, the device 100 hasthe primary screen 104 and the secondary screen 108 in a similarrelative relationship to one another as in the easel state 312, with thedifference being one of the primary screen 104 or the secondary screen108 are placed on a surface as shown.

State 320 is the open state where the primary screen 104 and thesecondary screen 108 are generally on the same plane. From the openstate, the device 100 can transition to the docked state 344 or the openlandscape state 348. In the open state 320, the primary screen 104 andthe secondary screen 108 are generally in the portrait-like orientationwhile in landscaped state 348 the primary screen 104 and the secondaryscreen 108 are generally in a landscape-like orientation.

State 324 is illustrative of a communication state, such as when aninbound or outbound call is being received or placed, respectively, bythe device 100. While not illustrated for clarity, it should beappreciated the device 100 can transition to the inbound/outbound callstate 324 from any state illustrated in FIG. 3. In a similar manner, theimage/video capture state 328 can be entered into from any other statein FIG. 3, with the image/video capture state 328 allowing the device100 to take one or more images via a camera and/or videos with a videocapture device 240.

Transition state 322 illustratively shows primary screen 104 and thesecondary screen 108 being closed upon one another for entry into, forexample, the closed state 304.

FIG. 3B illustrates, with reference to the key, the inputs that arereceived to detect a transition from a first state to a second state. InFIG. 3B, various combinations of states are shown with in general, aportion of the columns being directed toward a portrait state 352, alandscape state 356, and a portion of the rows being directed toportrait state 360 and landscape state 364.

In FIG. 3B, the Key indicates that “H” represents an input from one ormore Hall Effect sensors, “A” represents an input from one or moreaccelerometers, “T” represents an input from a timer, “P” represents acommunications trigger input and “I” represents an image and/or videocapture request input. Thus, in the center portion 376 of the chart, aninput, or combination of inputs, are shown that represent how the device100 detects a transition from a first physical state to a secondphysical state.

As discussed, in the center portion of the chart 376, the inputs thatare received enable the detection of a transition from, for example, aportrait open state to a landscape easel state—shown in bold—“HAT.” Forthis exemplary transition from the portrait open to the landscape easelstate, a Hall Effect sensor(“H”), an accelerometer (“A”) and a timer(“T”) input may be needed. The timer input can be derived from, forexample, a clock associated with the processor.

In addition to the portrait and landscape states, a docked state 368 isalso shown that is triggered based on the receipt of a docking signal372. As discussed above and in relation to FIG. 3, the docking signalcan be triggered by the association of the device 100 with one or moreother device 100 s, accessories, peripherals, smart docks, or the like.

User Interaction:

FIGS. 4A through 4H depict various graphical representations of gestureinputs that may be recognized by the screens 104, 108. The gestures maybe performed not only by a user's body part, such as a digit, but alsoby other devices, such as a stylus, that may be sensed by the contactsensing portion(s) of a screen 104, 108. In general, gestures areinterpreted differently, based on where the gestures are performed(either directly on the display 110, 114 or in the gesture captureregion 120, 124). For example, gestures in the display 110,114 may bedirected to a desktop or application, and gestures in the gesturecapture region 120, 124 may be interrupted as for the system.

With reference to FIGS. 4A-4H, a first type of gesture, a touch gesture420, is substantially stationary on the screen 104,108 for a selectedlength of time. A circle 428 represents a touch or other contact typereceived at particular location of a contact sensing portion of thescreen. The circle 428 may include a border 432, the thickness of whichindicates a length of time that the contact is held substantiallystationary at the contact location. For instance, a tap 420 (or shortpress) has a thinner border 432 a than the border 432 b for a long press424 (or for a normal press). The long press 424 may involve a contactthat remains substantially stationary on the screen for longer timeperiod than that of a tap 420. As will be appreciated, differentlydefined gestures may be registered depending upon the length of timethat the touch remains stationary prior to contact cessation or movementon the screen.

With reference to FIG. 4C, a drag gesture 400 on the screen 104,108 isan initial contact (represented by circle 428) with contact movement 436in a selected direction. The initial contact 428 may remain stationaryon the screen 104,108 for a certain amount of time represented by theborder 432. The drag gesture typically requires the user to contact anicon, window, or other displayed image at a first location followed bymovement of the contact in a drag direction to a new second locationdesired for the selected displayed image. The contact movement need notbe in a straight line but have any path of movement so long as thecontact is substantially continuous from the first to the secondlocations.

With reference to FIG. 4D, a flick gesture 404 on the screen 104,108 isan initial contact (represented by circle 428) with truncated contactmovement 436 (relative to a drag gesture) in a selected direction. Inembodiments, a flick has a higher exit velocity for the last movement inthe gesture compared to the drag gesture. The flick gesture can, forinstance, be a finger snap following initial contact. Compared to a draggesture, a flick gesture generally does not require continual contactwith the screen 104,108 from the first location of a displayed image toa predetermined second location. The contacted displayed image is movedby the flick gesture in the direction of the flick gesture to thepredetermined second location. Although both gestures commonly can movea displayed image from a first location to a second location, thetemporal duration and distance of travel of the contact on the screen isgenerally less for a flick than for a drag gesture.

With reference to FIG. 4E, a pinch gesture 408 on the screen 104,108 isdepicted. The pinch gesture 408 may be initiated by a first contact 428a to the screen 104,108 by, for example, a first digit and a secondcontact 428 b to the screen 104,108 by, for example, a second digit. Thefirst and second contacts 428 a,b may be detected by a common contactsensing portion of a common screen 104,108, by different contact sensingportions of a common screen 104 or 108, or by different contact sensingportions of different screens. The first contact 428 a is held for afirst amount of time, as represented by the border 432 a, and the secondcontact 428 b is held for a second amount of time, as represented by theborder 432 b. The first and second amounts of time are generallysubstantially the same, and the first and second contacts 428 a, bgenerally occur substantially simultaneously. The first and secondcontacts 428 a, b generally also include corresponding first and secondcontact movements 436 a, b, respectively. The first and second contactmovements 436 a, b are generally in opposing directions. Stated anotherway, the first contact movement 436 a is towards the second contact 436b, and the second contact movement 436 b is towards the first contact436 a. More simply stated, the pinch gesture 408 may be accomplished bya user's digits touching the screen 104,108 in a pinching motion.

With reference to FIG. 4F, a spread gesture 410 on the screen 104,108 isdepicted. The spread gesture 410 may be initiated by a first contact 428a to the screen 104,108 by, for example, a first digit and a secondcontact 428 b to the screen 104,108 by, for example, a second digit. Thefirst and second contacts 428 a,b may be detected by a common contactsensing portion of a common screen 104,108, by different contact sensingportions of a common screen 104,108, or by different contact sensingportions of different screens. The first contact 428 a is held for afirst amount of time, as represented by the border 432 a, and the secondcontact 428 b is held for a second amount of time, as represented by theborder 432 b. The first and second amounts of time are generallysubstantially the same, and the first and second contacts 428 a, bgenerally occur substantially simultaneously. The first and secondcontacts 428 a, b generally also include corresponding first and secondcontact movements 436 a,b, respectively. The first and second contactmovements 436 a, b are generally in a common direction. Stated anotherway, the first and second contact movements 436 a, b are away from thefirst and second contacts 428 a, b. More simply stated, the spreadgesture 410 may be accomplished by a user's digits touching the screen104,108 in a spreading motion.

The above gestures may be combined in any manner, such as those shown byFIGS. 4G and H, to produce a determined functional result. For example,in Fig. G a tap gesture 420 is combined with a drag or flick gesture 412in a direction away from the tap gesture 420. In Fig. H, a tap gesture420 is combined with a drag or flick gesture 412 in a direction towardsthe tap gesture 420.

The functional result of receiving a gesture can vary depending on anumber of factors, including a state of the device 100, display 110,114, or screen 104, 108, a context associated with the gesture, orsensed location of the gesture. The state of the device commonly refersto one or more of a configuration of the device 100, a displayorientation, and user and other inputs received by the device 100.Context commonly refers to one or more of the particular application(s)selected by the gesture and the portion(s) of the application currentlyexecuting, whether the application is a single- or multi-screenapplication, and whether the application is a multi-screen applicationdisplaying one or more windows in one or more screens or in one or morestacks. Sensed location of the gesture commonly refers to whether thesensed set(s) of gesture location coordinates are on a touch sensitivedisplay 110, 114 or a gesture capture region 120, 124, whether thesensed set(s) of gesture location coordinates are associated with acommon or different display or screen 104,108, and/or what portion ofthe gesture capture region contains the sensed set(s) of gesturelocation coordinates.

A tap, when received by an a touch sensitive display 110, 114, can beused, for instance, to select an icon to initiate or terminate executionof a corresponding application, to maximize or minimize a window, toreorder windows in a stack, and to provide user input such as bykeyboard display or other displayed image. A drag, when received by atouch sensitive display 110, 114, can be used, for instance, to relocatean icon or window to a desired location within a display, to reorder astack on a display, or to span both displays (such that the selectedwindow occupies a portion of each display simultaneously). A flick, whenreceived by a touch sensitive display 110, 114 or a gesture captureregion 120, 124, can be used to relocate a window from a first displayto a second display or to span both displays (such that the selectedwindow occupies a portion of each display simultaneously). Unlike thedrag gesture, however, the flick gesture is generally not used to movethe displayed image to a specific user-selected location but to adefault location that is not configurable by the user.

The pinch gesture, when received by a touch sensitive display 110, 114or a gesture capture region 120, 124, can be used to maximize orotherwise increase the displayed area or size of a window (typicallywhen received entirely by a common display), to switch windows displayedat the top of the stack on each display to the top of the stack of theother display (typically when received by different displays orscreens), or to display an application manager (a “pop-up window” thatdisplays the windows in the stack). The spread gesture, when received bya touch sensitive display 110, 114 or a gesture capture region 120, 124,can be used to minimize or otherwise decrease the displayed area or sizeof a window, to switch windows displayed at the top of the stack on eachdisplay to the top of the stack of the other display (typically whenreceived by different displays or screens), or to display an applicationmanager (typically when received by an off-screen gesture capture regionon the same or different screens).

The combined gestures of FIG. 4G, when received by a common displaycapture region in a common display or screen 104,108, can be used tohold a first window stack location in a first stack constant for adisplay receiving the gesture while reordering a second window stacklocation in a second window stack to include a window in the displayreceiving the gesture. The combined gestures of FIG. 4H, when receivedby different display capture regions in a common display or screen104,108 or in different displays or screens, can be used to hold a firstwindow stack location in a first window stack constant for a displayreceiving the tap part of the gesture while reordering a second windowstack location in a second window stack to include a window in thedisplay receiving the flick or drag gesture. Although specific gesturesand gesture capture regions in the preceding examples have beenassociated with corresponding sets of functional results, it is to beappreciated that these associations can be redefined in any manner toproduce differing associations between gestures and/or gesture captureregions and/or functional results.

Firmware and Software:

The memory 508 may store and the processor 504 may execute one or moresoftware components. These components can include at least one operatingsystem (OS) 516 a and/or 516 b, a framework 520, and/or one or moreapplication(s) 564 a and/or 564 b from an application store 560. Theprocessor 504 may receive inputs from drivers 512, previously describedin conjunction with FIG. 2. The OS 516 can be any software, consistingof programs and data, that manages computer hardware resources andprovides common services for the execution of various applications 564.The OS 516 can be any operating system and, at least in someembodiments, dedicated to mobile devices, including, but not limited to,Linux, Android, iPhone OS (iOS), Windows Phone 7, etc. The OS 516 isoperable to provide functionality to the phone by executing one or moreoperations, as described herein.

The applications 564 can be any higher level software that executesparticular functionality for the user. Applications 564 can includeprograms such as email clients, web browsers, texting applications,games, media players, office suites, etc. The applications 564 can bestored in an application store 560, which may represent any memory ordata storage, and the management software associated therewith, forstoring the applications 564. Once executed, the applications 564 may berun in a different area of memory 508.

The framework 520 may be any software or data that allows the multipletasks running on the device to interact. In embodiments, at leastportions of the framework 520 and the discrete components describedhereinafter may be considered part of the OS 516 or an application 564.However, these portions will be described as part of the middleware 520,but those components are not so limited. The framework 520 can include,but is not limited to, a Multi-Display Management (MDM) module 524, aSurface Cache module 528, a Window Management module 532, an InputManagement module 536, a Task Management module 540, a DisplayController, one or more frame buffers 548, a task stack 552, one or morewindow stacks 550 (which is a logical arrangement of windows and/ordesktops in a display area), and/or an event buffer 556.

The MDM module 524 includes one or more modules that are operable tomanage the display of applications or other data on the two screens ofthe device. An embodiment of the MDM module 524 is described inconjunction with FIG. 5B. In embodiments, the MDM module 524 receivesinputs from the OS 516, the drivers 512 and the applications 564. Theinputs assist the MDM module 524 in determining how to configure andallocate the displays according to the application's preferences andrequirements, and the user's actions. Once a determination for displayconfigurations is determined, the MDM module 524 can bind theapplications 564 to a display configuration. The configuration may thenbe provided to one or more other components to generate the display.

The Surface Cache module 528 includes any memory or storage and thesoftware associated therewith to store or cache one or more images fromthe display screens. Each display screen may have associated with thescreen a series of active and non-active windows (or other displayobjects (such as a desktop display)). The active window (or otherdisplay object) is currently being displayed. The non-active windows (orother display objects) were opened and/or at some time displayed but arenow “behind” the active window (or other display object). To enhance theuser experience, before being covered by another active window (or otherdisplay object), a “screen shot” of a last generated image of the window(or other display object) can be stored. The Surface Cache module 528may be operable to store the last active image of a window (or otherdisplay object) not currently displayed. Thus, the Surface Cache module528 stores the images of non-active windows (or other display objects)in a data store (not shown).

In embodiments, the Window Management module 532 is operable to managethe windows (or other display objects) that are active or not active oneach of the screens. The Window Management module 532, based oninformation from the MDM module 524, the OS 516, or other components,determines when a window (or other display object) is active or notactive. The Window Management module 532 may then put a non-visiblewindow (or other display object) in a “not active state” and inconjunction with the Task Management module 540 to suspend theapplication's operation. Further, the Window Management module 532 mayassign a screen identifier to the window (or other display object) ormanage one or more other items of data associated with the window (orother display object). The Window Management module 532 may also providethe stored information to the application 564, the Task Managementmodule 540, or other components interacting with or associated with thewindow (or other display object).

The Input Management module 536 is operable to manage events that occurwith the device. An event is any input into the window environment, forexample, a user interface interactions with a user. The Input Managementmodule 536 receives the events and logically stores the events in anevent buffer 556. Events can include such user interface interactions asa “down event,” which occurs when a screen 104, 108 receives a touchsignal from a user, a “move event,” which occurs when the screen 104,108 determines that a user's finger is moving across a screen(s), an “upevent, which occurs when the screen 104, 108 determines that the userhas stopped touching the screen 104, 108, etc. These events arereceived, stored, and forwarded to other modules by the Input Managementmodule 536.

A task can be an application component that provides a screen with whichusers can interact in order to do something, such as dial the phone,take a photo, send an email, or view a map. Each task may be given awindow in which to draw a user interface. The window typically fills thedisplay 110,114, but may be smaller than the display 110,114 and floaton top of other windows. An application usually consists of multipleactivities that are loosely bound to each other. Typically, one task inan application is specified as the “main” task, which is presented tothe user when launching the application for the first time. Each taskcan then start another task to perform different actions.

The Task Management module 540 is operable to manage the operation ofthe one or more applications 564 that may be executed by the device.Thus, the Task Management module 540 can receive signals to execute anapplication stored in the application store 560. The Task Managementmodule 540 may then instantiate one or more tasks or components of theapplication 564 to begin operation of the application 564. Further, theTask Management module 540 may suspend the application 564 based on userinterface changes. Suspending the application 564 may maintainapplication data in memory but may limit or stop access to processorcycles for the application 564. Once the application becomes activeagain, the Task Management module 540 can again provide access to theprocessor.

The Display Controller 544 is operable to render and output thedisplay(s) for the multi-screen device. In embodiments, the DisplayController 544 creates and/or manages one or more frame buffers 548. Aframe buffer 548 can be a display output that drives a display from aportion of memory containing a complete frame of display data. Inembodiments, the Display Controller 544 manages one or more framebuffers. One frame buffer may be a composite frame buffer that canrepresent the entire display space of both screens. This composite framebuffer can appear as a single frame to the OS 516. The DisplayController 544 can sub-divide this composite frame buffer as requiredfor use by each of the displays 110, 114. Thus, by using the DisplayController 544, the device 100 can have multiple screen displays withoutchanging the underlying software of the OS 516.

The Application Manager 562 can be a service that provides thepresentation layer for the window environment. Thus, the ApplicationManager 562 provides the graphical model for rendering by the WindowManagement Module 556. Likewise, the Desktop 566 provides thepresentation layer for the Application Store 560. Thus, the desktopprovides a graphical model of a surface having selectable applicationicons for the Applications 564 in the Application Store 560 that can beprovided to the Window Management Module 556 for rendering.

An embodiment of the MDM module 524 is shown in FIG. 5B. The MDM module524 is operable to determine the state of the environment for thedevice, including, but not limited to, the orientation of the device,what applications 564 are executing, how the applications 564 are to bedisplayed, what actions the user is conducting, the tasks beingdisplayed, etc. To configure the display, the MDM module 524 interpretsthese environmental factors and determines a display configuration, asdescribed in conjunction with FIGS. 6A-6J. Then, the MDM module 524 canbind the applications 564 or other device components to the displays.The configuration may then be sent to the Display Controller 544 and/orthe OS 516 to generate the display. The MDM module 524 can include oneor more of, but is not limited to, a Display Configuration Module 568, aPreferences Module 572, a Device State Module 574, a Gesture Module 576,a Requirements Module 580, an Event Module 584, and/or a Binding Module588.

The Display Configuration Module 568 determines the layout for thedisplay. In embodiments, the Display Configuration Module 568 candetermine the environmental factors. The environmental factors may bereceived from one or more other MDM module 524 modules or from othersources. The Display Configuration Module 568 can then determine fromthe list of factors the best configuration for the display. Someembodiments of the possible configurations and the factors associatedtherewith are described in conjunction with FIGS. 6A-6F.

The Preferences Module 572 is operable to determine display preferencesfor an application 564 or other component. For example, an applicationcan have a preference for Single or Dual displays. The PreferencesModule 572 can determine or receive the application preferences andstore the preferences. As the configuration of the device changes, thepreferences may be reviewed to determine if a better displayconfiguration can be achieved for the application 564.

The Device State Module 574 is operable to determine or receive thestate of the device. The state of the device can be as described inconjunction with FIGS. 3A and 3B. The state of the device can be used bythe Display Configuration Module 568 to determine the configuration forthe display. As such, the Device State Module 574 may receive inputs andinterpret the state of the device. The state information is thenprovided to the Display Configuration Module 568.

The Gesture Module 576 is operable to determine if the user isconducting any actions on the user interface. Thus, the Gesture Module576 can receive task information either from the task stack 552 or theInput Management module 536. These gestures may be as defined inconjunction with FIGS. 4A through 4H. For example, moving a windowcauses the display to render a series of display frames that illustratethe window moving. The gesture associated with such user interfaceinteraction can be received and interpreted by the Gesture Module 576.The information about the user gesture is then sent to the TaskManagement Module 540 to modify the display binding of the task.

The Requirements Module 580, similar to the Preferences Module 572, isoperable to determine display requirements for an application 564 orother component. An application can have a set display requirement thatmust be observed. Some applications require a particular displayorientation. For example, the application “Angry Birds” can only bedisplayed in landscape orientation. This type of display requirement canbe determined or received, by the Requirements Module 580. As theorientation of the device changes, the Requirements Module 580 canreassert the display requirements for the application 564. The DisplayConfiguration Module 568 can generate a display configuration that is inaccordance with the application display requirements, as provided by theRequirements Module 580.

The Event Module 584, similar to the Gesture Module 576, is operable todetermine one or more events occurring with an application or othercomponent that can affect the user interface. Thus, the Gesture Module576 can receive event information either from the event buffer 556 orthe Task Management module 540. These events can change how the tasksare bound to the displays. For example, an email application receivingan email can cause the display to render the new message in a secondaryscreen. The events associated with such application execution can bereceived and interpreted by the Event Module 584. The information aboutthe events then may be sent to the Display Configuration Module 568 tomodify the configuration of the display.

The Binding Module 588 is operable to bind the applications 564 or theother components to the configuration determined by the DisplayConfiguration Module 568. A binding associates, in memory, the displayconfiguration for each application with the display and mode of theapplication. Thus, the Binding Module 588 can associate an applicationwith a display configuration for the application (e.g. landscape,portrait, multi-screen, etc.). Then, the Binding Module 588 may assign adisplay identifier to the display. The display identifier associated theapplication with a particular screen of the device. This binding is thenstored and provided to the Display Controller 544, the OS 516, or othercomponents to properly render the display. The binding is dynamic andcan change or be updated based on configuration changes associated withevents, gestures, state changes, application preferences orrequirements, etc.

User Interface Configurations:

With reference now to FIGS. 6A-J, various types of output configurationsmade possible by the device 100 will be described hereinafter.

FIGS. 6A and 6B depict two different output configurations of the device100 being in a first state. Specifically, FIG. 6A depicts the device 100being in a closed portrait state 304 where the data is displayed on theprimary screen 104. In this example, the device 100 displays data viathe touch sensitive display 110 in a first portrait configuration 604.As can be appreciated, the first portrait configuration 604 may onlydisplay a desktop or operating system home screen. Alternatively, one ormore windows may be presented in a portrait orientation while the device100 is displaying data in the first portrait configuration 604.

FIG. 6B depicts the device 100 still being in the closed portrait state304, but instead data is displayed on the secondary screen 108. In thisexample, the device 100 displays data via the touch sensitive display114 in a second portrait configuration 608.

It may be possible to display similar or different data in either thefirst or second portrait configuration 604, 608. It may also be possibleto transition between the first portrait configuration 604 and secondportrait configuration 608 by providing the device 100 a user gesture(e.g., a double tap gesture), a menu selection, or other means. Othersuitable gestures may also be employed to transition betweenconfigurations. Furthermore, it may also be possible to transition thedevice 100 from the first or second portrait configuration 604, 608 toany other configuration described herein depending upon which state thedevice 100 is moved.

An alternative output configuration may be accommodated by the device100 being in a second state. Specifically, FIG. 6C depicts a thirdportrait configuration where data is displayed simultaneously on boththe primary screen 104 and the secondary screen 108. The third portraitconfiguration may be referred to as a Dual-Portrait (PD) outputconfiguration. In the PD output configuration, the touch sensitivedisplay 110 of the primary screen 104 depicts data in the first portraitconfiguration 604 while the touch sensitive display 114 of the secondaryscreen 108 depicts data in the second portrait configuration 608. Thesimultaneous presentation of the first portrait configuration 604 andthe second portrait configuration 608 may occur when the device 100 isin an open portrait state 320. In this configuration, the device 100 maydisplay one application window in one display 110 or 114, twoapplication windows (one in each display 110 and 114), one applicationwindow and one desktop, or one desktop. Other configurations may bepossible. It should be appreciated that it may also be possible totransition the device 100 from the simultaneous display ofconfigurations 604, 608 to any other configuration described hereindepending upon which state the device 100 is moved. Furthermore, whilein this state, an application's display preference may place the deviceinto bilateral mode, in which both displays are active to displaydifferent windows in the same application. For example, a Cameraapplication may display a viewfinder and controls on one side, while theother side displays a mirrored preview that can be seen by the photosubjects. Games involving simultaneous play by two players may also takeadvantage of bilateral mode.

FIGS. 6D and 6E depicts two further output configurations of the device100 being in a third state. Specifically, FIG. 6D depicts the device 100being in a closed landscape state 340 where the data is displayed on theprimary screen 104. In this example, the device 100 displays data viathe touch sensitive display 110 in a first landscape configuration 612.Much like the other configurations described herein, the first landscapeconfiguration 612 may display a desktop, a home screen, one or morewindows displaying application data, or the like.

FIG. 6E depicts the device 100 still being in the closed landscape state340, but instead data is displayed on the secondary screen 108. In thisexample, the device 100 displays data via the touch sensitive display114 in a second landscape configuration 616. It may be possible todisplay similar or different data in either the first or second portraitconfiguration 612, 616. It may also be possible to transition betweenthe first landscape configuration 612 and second landscape configuration616 by providing the device 100 with one or both of a twist and tapgesture or a flip and slide gesture. Other suitable gestures may also beemployed to transition between configurations. Furthermore, it may alsobe possible to transition the device 100 from the first or secondlandscape configuration 612, 616 to any other configuration describedherein depending upon which state the device 100 is moved.

FIG. 6F depicts a third landscape configuration where data is displayedsimultaneously on both the primary screen 104 and the secondary screen108. The third landscape configuration may be referred to as aDual-Landscape (LD) output configuration. In the LD outputconfiguration, the touch sensitive display 110 of the primary screen 104depicts data in the first landscape configuration 612 while the touchsensitive display 114 of the secondary screen 108 depicts data in thesecond landscape configuration 616. The simultaneous presentation of thefirst landscape configuration 612 and the second landscape configuration616 may occur when the device 100 is in an open landscape state 340. Itshould be appreciated that it may also be possible to transition thedevice 100 from the simultaneous display of configurations 612, 616 toany other configuration described herein depending upon which state thedevice 100 is moved.

FIGS. 6G and 6H depict two views of a device 100 being in yet anotherstate. Specifically, the device 100 is depicted as being in an easelstate 312. FIG. 6G shows that a first easel output configuration 618 maybe displayed on the touch sensitive display 110. FIG. 6H shows that asecond easel output configuration 620 may be displayed on the touchsensitive display 114. The device 100 may be configured to depict eitherthe first easel output configuration 618 or the second easel outputconfiguration 620 individually. Alternatively, both the easel outputconfigurations 618, 620 may be presented simultaneously. In someembodiments, the easel output configurations 618, 620 may be similar oridentical to the landscape output configurations 612, 616. The device100 may also be configured to display one or both of the easel outputconfigurations 618, 620 while in a modified easel state 316. It shouldbe appreciated that simultaneous utilization of the easel outputconfigurations 618, 620 may facilitate two-person games (e.g.,Battleship®, chess, checkers, etc.), multi-user conferences where two ormore users share the same device 100, and other applications. As can beappreciated, it may also be possible to transition the device 100 fromthe display of one or both configurations 618, 620 to any otherconfiguration described herein depending upon which state the device 100is moved.

FIG. 6I depicts yet another output configuration that may beaccommodated while the device 100 is in an open portrait state 320.Specifically, the device 100 may be configured to present a singlecontinuous image across both touch sensitive displays 110, 114 in aportrait configuration referred to herein as a Portrait-Max (PMax)configuration 624. In this configuration, data (e.g., a single image,application, window, icon, video, etc.) may be split and displayedpartially on one of the touch sensitive displays while the other portionof the data is displayed on the other touch sensitive display. The Pmaxconfiguration 624 may facilitate a larger display and/or betterresolution for displaying a particular image on the device 100. Similarto other output configurations, it may be possible to transition thedevice 100 from the Pmax configuration 624 to any other outputconfiguration described herein depending upon which state the device 100is moved.

FIG. 6J depicts still another output configuration that may beaccommodated while the device 100 is in an open landscape state 348.Specifically, the device 100 may be configured to present a singlecontinuous image across both touch sensitive displays 110, 114 in alandscape configuration referred to herein as a Landscape-Max (LMax)configuration 628. In this configuration, data (e.g., a single image,application, window, icon, video, etc.) may be split and displayedpartially on one of the touch sensitive displays while the other portionof the data is displayed on the other touch sensitive display. The Lmaxconfiguration 628 may facilitate a larger display and/or betterresolution for displaying a particular image on the device 100. Similarto other output configurations, it may be possible to transition thedevice 100 from the Lmax configuration 628 to any other outputconfiguration described herein depending upon which state the device 100is moved.

FIGS. 7A-7C illustrate an embodiment showing device 100 and how device100 responds when an incomplete gesture is made. FIG. 7A illustratesdevice 100 (with screens 104 and 108) when a focus is on screen 104 anddisplay area 110. As noted above, “focus” means active and selected forreceiving input. Accordingly, in FIG. 7A screen 104 and display area 110are active and selected for input. Highlight 704 provides an indicationto a user that screen 104 and display area 110 have the focus. If a userpresses configurable area 112, device 100 will consider the inputs asinputs for screen 104 and/or for display 110.

As shown in FIG. 7B, a user can make a gesture 708, such as a drag orflick gesture on gesture capture area 120. Device 100 receives thegesture. A determination is made by device 100 as to whether the gesture708 was complete. If the gesture was not complete, then as shown in FIG.7C the focus is maintained on screen 104 and display area 110.

Highlighting 704 as noted above, indicates that screen 104 and display110 are active. Highlighting 704 can be effected in a number ofdifferent ways. In some embodiments, the highlighting 704 isaccomplished using light. In these embodiments, a backlight in device100 may be configured to provide brighter light in some areas, such asaround a border as shown in FIGS. 7A-7C. In other embodiments, thebrighter light may be located on just one side/area or may be the entiredisplay 110, which is made brighter than at least a portion of screen108 and/or display 114.

In other embodiments, highlighting 704 may be accomplished using color,or a displayed image such as an icon that indicates that the screen 104and display 110 have the focus. In other embodiments, the highlightingmay be accomplished by some other difference, such as changing text to adifferent font type, size, or other characteristic. In some embodiments,the highlighting can be accomplished, or enhanced, by changing adifferent screen, display, and/or displayed image. For example, inembodiments, the screen, display and/or displayed image that does nothave the focus, will be deemphasized by darkening, a color change, orother features that distinguishes it from the highlighted screen,display, and/or image. As can be appreciated, a combination of one ormore of the above highlighting features may be used in some embodiments.

In one embodiment, in addition to highlighting 704, configurable area112 of screen 104 is highlighted to indicate that screen 104 and display110 have the focus. Device 100 can be configured so that configurableareas are only highlighted when the corresponding screen has the focus.That is, configurable area 112 is highlighted when screen 104 is infocus, while configurable area 116 is highlighted when focus is onscreen 108. As indicated above, the highlighting may be effected bylighting, color, or an image displayed near the configurable area. Inthe embodiment, shown in FIGS. 7A-7C, when screen 104 is in focus, theconfigurable area 112 is back lit to show buttons that can be used toreceive input from a user.

In some embodiments, when configurable area 112 is highlighted, inputcan be received by pressing portions of area 112. At the same time,device 100 may be configured so that no input is received fromconfigurable area 116. Thus, even if a user presses on area 116, noinput will be received by device 100. Similarly, when configurable area116 is highlighted device 100 will allow input to be received from area116, and no input will be received from area 112. In other embodiments,only one configurable area will be highlighted at a time reflecting theparticular screen, display, or image that is in focus. That is, whenconfigurable area 112 is highlighted configurable area 116 will not behighlighted, and when configurable area 116 is highlighted configurablearea 112 will not be highlighted.

It is noted that although gesture 708 is being made in gesture capturearea 120, which is not on display 110, in other embodiments, the gesture708 is made on one or more portions of displays 110 and 114. The gesture708 may involve touching some portion of displays 110 and 114 (which aretouch sensitive) or can involve only movement above the surface ofdisplays 110 and 114.

In some embodiments, even though the gesture 708 is incomplete, device100 may be configured to make changes to displays 104 and 108 to showthat gesture 704 has been received. For example, in some embodimentsimage 712 (all of the image(s) displayed on display 110) appears to moveacross both displays 110 and 114 when gesture 708 is received. Thisfeature allows a user to appreciate that the gesture 708 has beenreceived, however it is probably incomplete as the focus was not changedto screen 108 and display 114 and was maintained on screen 104 anddisplay 108 (FIG. 7C). The user can then make the gesture 708 again.This feature provides some visual feedback to a user regarding theincomplete gesture.

FIGS. 8A-8C illustrate another embodiment that provides feedback to auser about an incomplete gesture. FIG. 8A illustrates an image 804displayed on display 110. The image 804 may be any type of displayedimage such as a photo, a document, an icon that represent anapplication, or a window of an application. Image 804 is highlighted inFIG. 8A indicating that it is in focus. When gesture 708 is received bygesture capture area 120, image 804 appears to move from display 110 todisplay 114. Because a determination is made that the gesture was notcomplete, the image 804 is returned back to its original position. Themovement of image 804 indicates to a user that the gesture 708 wasreceived but because image 804 was not displayed on display 114 it musthave been incomplete. The user can then make gesture 708 again to changefocus.

In some embodiments, image 712 or image 804 may be displayed as movingdepending upon how device 100 is configured. For example, the device 100may be configured to move image 712 (entire image(s) displayed ondisplay 110) when the gesture 708 is a drag gesture and image 804(active window, icon, photo, document) if gesture 708 is a flick gestureor some other gesture. In other embodiments, the location of the gesture708, whether in gesture capture region 120 or some other portion ofdisplays 110 and 114, may determine whether image 710 or image 804 isshown as moving from display 110 to display 114.

FIGS. 9A-9C illustrates an embodiment of device 100 and its output inresponse to receiving a completed gesture. In FIG. 9A the focus is onscreen 104, display 110, and image 804. Image 804 is in embodiments awindow of an active application which is selected to receive input froma user. In the embodiment shown in FIGS. 9A-9C, a user makes a gesture708 in gesture capture region 120. The gesture is a complete gesture. Inresponse to the complete gesture, device 100 changes focus away fromscreen 104, display 110, and image 804 and to screen 108 and display114.

In some embodiments, as shown in FIG. 9C, in addition to changing thefocus to screen 108 and display 114, the focus is also automatically onan image that is displayed on display 114, i.e., image 904. In theseembodiments, device 100 may be configured by a user so that when focusis changed to a screen or display, the focus will also be on an image,e.g., a window of an open application, if one is open on the display towhich the focus has changed. The user may, for example, listapplications in order of priority such that if there is an open windowthe focus will change to an application at the top of the list. If nowindow is open for an application at the top the list, then the list canbe traversed in order of priority until an application with an openwindow is found. If none of the applications on the list have openwindows then the focus will not change to any images on the display. Insome embodiments, the focus may be changed to a window of the sameapplication that was previously in focus.

In other embodiments, the focus may always change to a default image(e.g., open window) selected by a user. In some embodiments, if thedefault application does not have an open window, device 100 may beconfigured to launch the application and open a window that will then bein focus.

In some embodiments, device 100 is configured so that depending upon theparticular gesture 708, an image on the newly focused display may be infocus or not. For example, the device 100 may be configured to have inimage in focus when the gesture 708 is a drag gesture. If the gesture708 is a flick gesture or some other gesture, no image will be in focus,and instead only display 114 will be focus. In other embodiments, thelocation of the gesture 708, whether in gesture capture region 120 orsome other portion of displays 110 and 114, may determine whether animage on the newly focused display may be in focus or not.

It is noted that although gesture 708 is being made in gesture capturearea 120, which is not on display 110 or display 114, in otherembodiments, the gesture 708 is made on one or more portions of displays110 and 114. The gesture 708 may involve touching some portion ofdisplays 110 and 114 (which are touch sensitive) or can involve onlymovement above the surface of displays 110 and 114.

As shown in FIG. 9C, when focus is changed to screen 108 and display114, configurable area 116 is highlighted to indicate that the focus ischanged. Device 100 can be configured so that configurable areas areonly highlighted when the corresponding screen has the focus. That is,configurable area 112 is highlighted when screen 104 and/or display 110is in focus, while configurable area 116 is highlighted when focus is onscreen 108 and/or display 114. As indicated above, the highlighting maybe effected by lighting, color, or an image displayed near theconfigurable area. In the embodiment, shown in FIGS. 9A-9C, when screen104 and/or display 110 is in focus, the configurable area 112 is backlit to show buttons that can be used to receive input from a user.Similarly, when focus changes to screen 108 and/or display 114, theconfigurable area 116 is back lit to show buttons that can be used toreceive input from a user.

Referring now to FIG. 10, a flow diagram 1000 in accordance with atleast some embodiments of the present disclosure is shown and will bedescribed. Flow 1000 is in embodiments performed by a device such asdevice 100. More specifically, one or more hardware or softwarecomponents may be involved in performing flow 1000. In one embodiment,modules in middleware 520 (FIG. 5A) such as multi-display managementclass 524 (FIG. 5B) perform one or more of the steps of flow 1000. Inother embodiments, in addition to, or in lieu of, middleware 520performing steps of flow 1000, operating system kernel(s) 516 a,processor 504, and/or drivers 512 a-512 b may also perform steps of flow1000.

Flow 1000 is initiated at 1004. Flow 1000 passes from 1004 to optionalstep 1008 where input regarding focus behavior is received. In thisstep, a user may provide configuration information that indicates how adevice should handle focus when receiving gestures. In embodiments, thedevice is device 100 (FIGS. 1-3) which includes multiple screens. Theuser may input any information that affects how a device 100 may handleinput gestures, including but not limited to, changes (if any) thatoccur to displays 104 and 108 when gestures are incomplete to show thata gesture has been received, what is highlighted when focus is changed,priority list of applications when focus is changed, whether focuschanges are limited to a display, screen, and/or displayed image,whether focus behavior changes based on the type of gesture received,and other information. In one embodiment, the input indicates that inresponse to an incomplete gesture, the focus should be maintained on thescreen, display, and/or image with the focus.

From step 1008, flow 1000 passes to step 1012 where a gesture isreceived. The gesture can be received in some embodiments by a gesturecapture area such as areas 120 and 124 and/or pressure sensitivedisplays 110 and 114. In some embodiments, as shown in FIGS. 1 and 2,the gesture capture area(s) is distinct and located away from thepressure sensitive displays. In other embodiments the gesture capturearea may overlap partially or completely with the pressure sensitivedisplays.

The gesture may be any type of gesture. In embodiments, the gesture isone or more of the gestures illustrated in FIG. 4A-4H. The device 100 isconfigured so that the gesture received at step 1012 indicates a requestto change focus from the current focus.

In some embodiments, flow 1000 may include an optional step 1016 thatchanges one or more of the displays to indicate the receipt of thegesture. The change may be for example, moving an image displayed on afirst screen toward a second screen. The particular changes made to thedisplays may be based, in part, on the information received at optionalstep 1008.

After step 1016, a determination is made at 1020 as to whether thegesture is complete. A determination can be made that the gesture iscomplete if the input is recognized as a complete gesture. In otherwords, data at step 1012 corresponds to a gesture stored within thememory of device 100. If, however, the data received at step 1012 doesnot correspond to any gesture stored within the memory of device 100,then a determination can be made that the gesture is not complete.

In those embodiments in which the gesture is complete, flow 1000 passesfrom determination 1020 to step 1024 where the focus is changed. Thefocus is changed in accordance with predetermined configurations, someof which may be based on the input received at optional step 1008. Forexample, if the device 100 is configured so that the gesture received atstep 1012 indicates that the focus should be changed to a seconddisplay, at step 1024 the focus will be changed to the second display.If the configuration information indicates that the focus should also bechanged to an open window displayed on the second display, then at step1024 the open window displayed on the second display will also be infocus. After step 1024, flow 1000 ends at 1028.

It should be noted that in some embodiments, step 1024 may involve anumber of sub steps. For example, in some embodiments as part of step1024, a configurable area may be highlighted, a display may behighlighted, an icon may be generated indicating the focus change,and/or portions of a first screen may be changed to emphasize thehighlighting on a second screen. In some embodiments, the substeps mayinvolve not allowing input from a configurable area associated with afirst screen and allowing input from a configurable area associated witha second screen.

If at determination 1020, it is determined that the gesture is notcomplete, then flow passes to step 1032. At step 1032, the focus ismaintained on the screen, display, and/or image where it is currently.Flow 1000 ends at 1028.

The exemplary systems and methods of this disclosure have been describedin relation to FIGS. 1-10. However, to avoid unnecessarily obscuring thepresent disclosure, the preceding description omits a number of knownstructures and devices. This omission is not to be construed as alimitation of the scopes of the claims. Specific details are set forthto provide an understanding of the present disclosure. It should howeverbe appreciated that the present disclosure may be practiced in a varietyof ways beyond the specific detail set forth herein.

Furthermore, while the exemplary aspects, embodiments, and/orconfigurations illustrated herein show the various components of thesystem collocated, certain components of the system can be locatedremotely, at distant portions of a distributed network, such as a LANand/or the Internet, or within a dedicated system. Thus, it should beappreciated, that the components of the system can be combined in to oneor more devices, such as a ______, or collocated on a particular node ofa distributed network, such as an analog and/or digitaltelecommunications network, a packet-switch network, or acircuit-switched network. It will be appreciated from the precedingdescription, and for reasons of computational efficiency, that thecomponents of the system can be arranged at any location within adistributed network of components without affecting the operation of thesystem. For example, the various components can be located in a switchsuch as a PBX and media server, gateway, in one or more communicationsdevices, at one or more users' premises, or some combination thereof.Similarly, one or more functional portions of the system could bedistributed between a telecommunications device(s) and an associatedcomputing device.

Furthermore, it should be appreciated that the various links connectingthe elements can be wired or wireless links, or any combination thereof,or any other known or later developed element(s) that is capable ofsupplying and/or communicating data to and from the connected elements.These wired or wireless links can also be secure links and may becapable of communicating encrypted information. Transmission media usedas links, for example, can be any suitable carrier for electricalsignals, including coaxial cables, copper wire and fiber optics, and maytake the form of acoustic or light waves, such as those generated duringradio-wave and infra-red data communications.

Also, while the flowcharts have been discussed and illustrated inrelation to a particular sequence of events, it should be appreciatedthat changes, additions, and omissions to this sequence can occurwithout materially affecting the operation of the disclosed embodiments,configuration, and aspects.

A number of variations and modifications of the disclosure can be used.It would be possible to provide for some features of the disclosurewithout providing others.

For example in one alternative embodiment, all of the focus behaviorinformation may be preprogrammed into the device 100. In theseembodiments, there would be no input received by a user regarding how adevice 100 handles gestures indicating a change in focus.

In other alternative embodiments, device 100 may be in any configurationdescribed above with respect to FIGS. 6A-6J. In these embodiments,gestures would be received as described above indicating a request forchanging focus. The focus would then change from a first screen,display, or image to a second screen, display, or image.

In yet another embodiment, the systems and methods of this disclosurecan be implemented in conjunction with a special purpose computer, aprogrammed microprocessor or microcontroller and peripheral integratedcircuit element(s), an ASIC or other integrated circuit, a digitalsignal processor, a hard-wired electronic or logic circuit such asdiscrete element circuit, a programmable logic device or gate array suchas PLD, PLA, FPGA, PAL, special purpose computer, any comparable means,or the like. In general, any device(s) or means capable of implementingthe methodology illustrated herein can be used to implement the variousaspects of this disclosure. Exemplary hardware that can be used for thedisclosed embodiments, configurations and aspects includes computers,handheld devices, telephones (e.g., cellular, Internet enabled, digital,analog, hybrids, and others), and other hardware known in the art. Someof these devices include processors (e.g., a single or multiplemicroprocessors), memory, nonvolatile storage, input devices, and outputdevices. Furthermore, alternative software implementations including,but not limited to, distributed processing or component/objectdistributed processing, parallel processing, or virtual machineprocessing can also be constructed to implement the methods describedherein.

In yet another embodiment, the disclosed methods may be readilyimplemented in conjunction with software using object or object-orientedsoftware development environments that provide portable source code thatcan be used on a variety of computer or workstation platforms.Alternatively, the disclosed system may be implemented partially orfully in hardware using standard logic circuits or VLSI design. Whethersoftware or hardware is used to implement the systems in accordance withthis disclosure is dependent on the speed and/or efficiency requirementsof the system, the particular function, and the particular software orhardware systems or microprocessor or microcomputer systems beingutilized.

In yet another embodiment, the disclosed methods may be partiallyimplemented in software that can be stored on a storage medium, executedon programmed general-purpose computer with the cooperation of acontroller and memory, a special purpose computer, a microprocessor, orthe like. In these instances, the systems and methods of this disclosurecan be implemented as program embedded on personal computer such as anapplet, JAVA® or CGI script, as a resource residing on a server orcomputer workstation, as a routine embedded in a dedicated measurementsystem, system component, or the like. The system can also beimplemented by physically incorporating the system and/or method into asoftware and/or hardware system.

Although the present disclosure describes components and functionsimplemented in the aspects, embodiments, and/or configurations withreference to particular standards and protocols, the aspects,embodiments, and/or configurations are not limited to such standards andprotocols. Other similar standards and protocols not mentioned hereinare in existence and are considered to be included in the presentdisclosure. Moreover, the standards and protocols mentioned herein andother similar standards and protocols not mentioned herein areperiodically superseded by faster or more effective equivalents havingessentially the same functions. Such replacement standards and protocolshaving the same functions are considered equivalents included in thepresent disclosure.

The present disclosure, in various aspects, embodiments, and/orconfigurations, includes components, methods, processes, systems and/orapparatus substantially as depicted and described herein, includingvarious aspects, embodiments, configurations embodiments,subcombinations, and/or subsets thereof. Those of skill in the art willunderstand how to make and use the disclosed aspects, embodiments,and/or configurations after understanding the present disclosure. Thepresent disclosure, in various aspects, embodiments, and/orconfigurations, includes providing devices and processes in the absenceof items not depicted and/or described herein or in various aspects,embodiments, and/or configurations hereof, including in the absence ofsuch items as may have been used in previous devices or processes, e.g.,for improving performance, achieving ease and\or reducing cost ofimplementation.

The foregoing discussion has been presented for purposes of illustrationand description. The foregoing is not intended to limit the disclosureto the form or forms disclosed herein. In the foregoing DetailedDescription for example, various features of the disclosure are groupedtogether in one or more aspects, embodiments, and/or configurations forthe purpose of streamlining the disclosure. The features of the aspects,embodiments, and/or configurations of the disclosure may be combined inalternate aspects, embodiments, and/or configurations other than thosediscussed above. This method of disclosure is not to be interpreted asreflecting an intention that the claims require more features than areexpressly recited in each claim. Rather, as the following claimsreflect, inventive aspects lie in less than all features of a singleforegoing disclosed aspect, embodiment, and/or configuration. Thus, thefollowing claims are hereby incorporated into this Detailed Description,with each claim standing on its own as a separate preferred embodimentof the disclosure.

Moreover, though the description has included description of one or moreaspects, embodiments, and/or configurations and certain variations andmodifications, other variations, combinations, and modifications arewithin the scope of the disclosure, e.g., as may be within the skill andknowledge of those in the art, after understanding the presentdisclosure. It is intended to obtain rights which include alternativeaspects, embodiments, and/or configurations to the extent permitted,including alternate, interchangeable and/or equivalent structures,functions, ranges or steps to those claimed, whether or not suchalternate, interchangeable and/or equivalent structures, functions,ranges or steps are disclosed herein, and without intending to publiclydedicate any patentable subject matter.

1. (canceled)
 2. (canceled)
 3. (canceled)
 4. (canceled)
 5. (canceled) 6.(canceled)
 7. (canceled)
 8. (canceled)
 9. (canceled)
 10. (canceled) 11.(canceled)
 12. (canceled)
 13. (canceled)
 14. (canceled)
 15. (canceled)16. (canceled)
 17. (canceled)
 18. (canceled)
 19. (canceled) 20.(canceled)
 21. A method, comprising: providing a multi-display devicehaving at least a first display and a second display, wherein each ofthe first display and the second display include a touch sensitivedisplay, which displays application content and receives touch gestures,and a gesture capture region, which does not display application contentbut receives touch gesture, and wherein the gesture capture region isphysically separate from the touch sensitive display, wherein a focus ison a first display; receiving, by a gesture capture region, on a firstdisplay, which receives touch gestures, a drag or other touch gestureindicating a request to change focus; while the gesture is beingreceived, displaying, on one or more of a first display or a seconddisplay, a transition that animates the gesture and is associated withthe gesture; determining, by at least one processor, whether the gestureis completed or is abandoned; and in response to the at least oneprocessor determining that the gesture is abandoned, maintaining a focuson the first display that has the focus.
 22. The method of claim 21,further comprising: in response to the at least one processordetermining that the gesture is completed, changing the focus from thefirst display to a second display.
 23. The method of claim 21, furthercomprising: in response to the determining that the gesture iscompleted, further changing the focus from a first image displayed onthe first display to a second image displayed on a second display. 24.The method of claim 23, further comprising: wherein the first displayedimage is a displayed window and the second displayed image is a secondwindow.
 25. The method of claim 21, further comprising: receiving inputindicating that in response to an incomplete gesture, the focus shouldbe maintained on the first display.
 26. The method of claim 21, furthercomprising: highlighting a configurable area on the first display whenthe focus is on the display; and highlighting a second configurable areaon the second display when the focus is on the second display.
 27. Themethod of claim 21, further comprising: in response to receiving thegesture, displaying at least one image displayed on the first display asmoved from an New position.
 28. The method of claim 27, in response toreceiving the gesture, displaying the at least one image as moved in adirection of the gesture.
 29. The method of claim 28, furthercomprising: in response to the determining that the gesture isincomplete, displaying the at least one image in the New position.
 30. Anon-transitory computer readable medium storing computer executableinstructions that when executed by at least one processor of amulti-display device, wherein the multi-display device includes at leasta first display and a second display, wherein each of the first displayand the second display include a touch sensitive display, which displaysapplication content and receives touch gestures, and a gesture captureregion, which does not display application content but receives touchgesture, and wherein the gesture capture region is physically separatefrom the touch sensitive display, the instruction causing the processorto perform a method comprising: with a focus on a first image on thefirst display, receiving, by a gesture capture region, on a first orsecond display, which receives touch gestures, a drag gesture or othertouch gesture indicating a request to change focus; while the gesture isbeing received, displaying, on one or more of the first display or thesecond display, a transition associated with the gesture; determining,by at least one processor, whether the drag gesture is completed or isabandoned; in response to the at least one processor determining thatthe drag gesture is not completed, maintaining the focus on the firstimage displayed on the first display; and in response to the at leastone processor determining that the gesture is completed, changing thefocus from the first image to a second image displayed on the seconddisplay.
 31. The non-transitory computer readable medium of claim 30,wherein the method further comprises: in response to the at least oneprocessor determining that the drag gesture is not completed,maintaining a lighting of a portion of a first configurable area of thefirst display.
 32. The non-transitory computer readable medium of claim31, wherein the method further comprises: allowing input from the firstconfigurable area.
 33. The non-transitory computer readable medium ofclaim 30, wherein the method further comprises: in response to the atleast one processor determining that the gesture is completed, darkeninga first portion of the first configurable area of the first display andlighting up a second portion of a second configurable area of the seconddisplay.
 34. The non-transitory computer readable medium of claim 33,wherein the method further comprises: allowing input from the secondconfigurable area; and not allowing input from the first configurablearea.
 35. The non-transitory computer readable medium of claim 30,wherein the method further comprises: receiving input indicating that inresponse to an incomplete gesture, the focus should be maintained on adisplayed image with the focus.
 36. The non-transitory computer readablemedium of claim 30, wherein the first displayed image is a first windowand the second displayed image is a second window.
 37. A dual displaycommunication device, comprising: a first display comprising: a firsttouch sensitive display, which displays application content and receivestouch gestures; a first gesture capture region, which does not displayapplication content but receives touch gestures, separate from the firsttouch sensitive display, to receive a gesture; a second displaycomprising: a second touch sensitive display, which displays applicationcontent and receives touch gestures; a second gesture capture region,separate from the second touch sensitive display, to receive thegesture, which does not display application content but receives touchgestures; a non-transitory computer readable medium that stores computerexecutable instructions that when executed by at least one processorperform a method comprising: with a focus on the first display,receiving, by one of the first or second gesture capture region, thegesture indicating a request to change focus; while the gesture is beingreceived, displaying, on one or more of the first display or the seconddisplay, a transition associated with the gesture; determining, by atleast one processor, whether the gesture is completed or is abandoned;and in response to the at least one processor determining that thegesture is abandoned, maintaining the focus on the first touch sensitivedisplay.
 38. The dual display communication device of claim 37, whereinthe method further comprises: in response to the at least one processordetermining that the gesture is completed, changing the focus from thefirst touch sensitive display to a second touch sensitive display. 39.The dual display communication device of claim 37, wherein the methodfurther comprises: in response to the at least one processor determiningthat the drag gesture is not completed, allowing input from the firsttouch sensitive display and not allowing input from a portion of thesecond touch sensitive display.
 40. The dual display communicationdevice of claim 37, wherein the method further comprises: in response tothe at least one processor determining that the drag gesture iscompleted, allowing input from the second touch sensitive display andnot allowing input from a portion of the first touch sensitive display.